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Quantum annealing is analogous to simulated annealing with a tunneling mechanism 
substituting for thermal activation. Its performance has been tested in numerical simulation 
with mixed conclusions. There is a class of optimization problems for which the efficiency can 
be studied analytically using techniques based on the statistical mechanics of spin glasses. 

§1. Introduction 

Solving hard combinatorial problems by temperature annealing is a classic method 
in computer science. 1 ) The problem is formulated in terms of a cost function, which 
one can identify as an energy. The dynamics are then a combination of a systematic 
descent in energy perturbed by a 'noise', which is turned off gradually, inducing 
occasional upward jumps. This thermal activation allows the system to surmount 
barriers and avoid getting blocked in a local minimum. 

Quantum annealing is an analogous procedure, but with quantum tunneling sub- 
stituting for thermal activation. A major question is whether quantum algorithms 
that anneal by gradually turning off the term that induces quantum jumps 2 )' 3 ) - 
such as a transverse magnetic field in spin systems - can be an efficient strategy that 
outperforms classical optimization methods. 

In the past few years, there have been several attempts to simulate quantum 
annealing of simple "benchmark" models, in order to estimate the scaling of the 
time r needed in terms of the system size iV. 2 )' 3 )' 5 ) This time is bounded by the 
minimal energy gap A between the ground state and the first excited state: one 
can estimate 2 )' 3 )' 13 ) the time needed for quantum annealing to find the ground state 
as r a A~ 2 . In the most optimistic scenario, 5 ) a problem taking r ~ e aN in a 
classical computer would be solved in r ~ N a in a quantum one - corresponding to 
a minimal gap ~ N~ a / 2 . A more modest achievement, would be that the problem 
stays exponential, but with a smaller coefficient a (as is the case of the Grover 7 ) 
algorithm): this is what would at best happen if the gap is exponentially small. 

Because, at present, the simulations are done emulating quantum systems with 
classical computers, the sizes accessible are rather small, and the extrapolation of the 
gap dependence to larger systems risky. For this reason, it is particularly desirable 
to have an analytic framework within which one can compute A for a representative 
class of models. In a recent work, we have considered the group of systems having 
a 'Random First Order' (RFO) glass transition. 4 ) This class of models 11 ) is cur- 
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rently believed to be the mean-field version of the glass transition 12 ) and random 
heteropolymer folding. 14 ) It also includes random constraint satisfaction problems 
such as random satisfiability 15 ) (the energy to be minimized is the number of violated 
constraints) and is closely related to the random code ensemble in coding theory. 17 ) 

The phase diagrams of quantum spin glasses have been investigated extensively 
over the last thirty years, using a formalism combining the Replica 10 ) and the Suzuki- 
Trotter methods 18 )' 19 )' 23 ) in order to deal simultaneously with disorder and quantum 
mechanics. This formalism was first applied by Goldschmidt 18 ) to the paradigm 
of the class, the quantum Random Energy Model. An important result is that 
the quantum transition is of first order (with a discontinuity in the energy) at low 
temperature for all RFO models, unlike their classical transition in temperature, 
which is thermodynamically of second order. 

In order to assess the efficiency of quantum annealing knowledge of the thermo- 
dynamics of the model is not enough; we must compute the gap between the two 
lowest eigenvalues. This is not given by the usual replica solution, and one has to 
develop stronger techniques to obtain it. In what follows, we shall first show how 
to solve the Quantum Random Energy Model by elementary methods, including the 
calculation of the gap. Quantum Annealing turns out not to be an efficient way 
of computing its ground state for reasons that are very clear and require minimal 
technique to understand. Unfortunately, such elementary perturbative methods do 
not allow us to solve a general model of the class, and in particular to compute 
the minimal gap. We have hence to resort to more powerful, yet less transparent, 
methods which we have developed and we shall describe below. 

As we shall see, the minimal gap between the lowest states in all models of the 
RFO class can be expected to be exponentially small in N, implying that quantum 
annealing is an exponentially slow algorithm for those problems. 

§2. The simplest case: Random Energy Model 

The random energy model 9 ) is the simplest mean field spin-glass model, 11 ) yet 
it allows us to understand the very complex mechanisms of the mean-field spin- 
glass 11 ) and glass transitions. 12 ) We shall first use this model to study the effect of 
a quantum transverse field in the mean field transition in spin-glasses. The problem 
was already investigated twenty years ago, 18 ) by considering the p — ► oo limit of 
p-spin model using the replica method and the Suzuki- Trotter formalism, and many 
generalizations followed. 23 ) Here we shall show that it can be solved in a very simple 
way, that does not require the use of replica techniques. We consider N quantum 
spins a in a transverse field r with the Hamiltonian 

N 

H({*}) = E({a*}) + TV = E({a z }) + r £ of (2-1) 

i=i 

E({a z }) denotes a quenched random function that is diagonal in the basis \crf) ® 
| erf) ® ••• <S> \cr z N ) and consists of 2^ random, uncorrelated values. These values are 
taken from a Gaussian distribution of zero mean and variance N/2, as in the classical 



Quantum annealing 



3 



REM. 9 ) 7i is thus a 2^ x 2^ matrix whose entries are 7i aa = E a (the random energies) 
and 7i a b = r if a and b are two configurations that differ by a single spin flip, and 
zero otherwise. Note that since 7i is sparse, it can be studied numerically even when 
its dimensions are large. 

Just as in the classical case, a concrete implementation of the model is a spin 
glass with p-spin interactions, in the large p limit: 

N 

h = - Ji,...i p a! 1 ...a! p -rJ2^^T+rv, (2-2) 

ii<...<i p i=l 



where Ji Y ...% v are Gaussian variables with variance y N ^'_ 1 

2.1. Two easy limits 

The model is trivially solved in the limits r — > and r —* oo. 

a) r = 0: For i -1 = 0, we recover the classical REM with N Ising spins and 2^ 
configurations, each corresponding to an energy level E a : 11 ^ Call n(E) the number 
of energy levels belonging to the interval (E, E + dE); its average over all realizations 
is easily computed: n(£) = 2 N P(E) oc e ^{^-^/^)) = e Ns(E/N)^ where 

s(e) = ln2 — e 2 (with e = E/N). There is therefore a critical energy density 
eo = — Vln2 such that, if e < eo, then with high probability there are no configura- 
tions while if e > eo the entropy density is finite. A transition between these two 
regimes arises at ^- = ^p| eo = 2\/ln2 and the thermodynamic behavior follows: 

i) For T < T c , /rem = — Vln2 and the system is frozen in its lowest energy states. 
Only a finite number of levels (and only the ground state at T = 0) contribute 
to the partition sum. The energy gap between them is finite, (ii) For T > T c , 
/rem = — jf — Tln2; exponentially many configurations contribute to the partition 
sum. 

b) : In the opposite case of r — > oo, the REM contribution to the energy can 
be neglected. In the a x basis, we find iV independent classical spins in a field -T; the 
entropy density is just given by the log of a binomial distribution between —TN and 
+rN and the free-energy density is / par a = — Tln2 — rin((cosh/ 1 /T)). 

2.2. Perturbation theory 



Between these two extreme limits, it turns out that nothing much happens: the 
system is either in the "classical" or in the "extreme quantum" phase, and it jumps 
suddenly - in a first order fashion - from one to the other. This is important for 
us, since it means that most of the effort in quantum annealing is in fact wasted 
in staying on the same state, until suddenly the wave function projects onto the 
exact solution, and then never changes again. At low value of r, the free-energy 
density is that of the classical REM, while for larger values it jumps to the quantum 
paramagnetic (QP) value /qp; a first-order transition separates the two different 
behaviors at the value r such that /rem = /qp (see center panel of Fig. [2| . 

Let us see how this comes about in the restricted case of zero temperature, 
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using Rayleigh-Schrodinger perturbation theory. 20 ) Consider the set of eigenvalues 
Ek and eigenvectors \k) of the unperturbed REM, when r = 0. The series for a 
given perturbed eigenvalue Ei{r) reads 



Ei{r) = Ei + 



Y^rv 



n=0 



Q 



Ei — Wo 



(Ei-Ei(r) + rv) 



where the projector Q = Ylk^i so that 

Ei(r) = Ei + rvu + 

k+i 



r VjkVki 

Ei — Ek 



+ ■ 



(2-3) 



Since V%j ^ if and only if i and j are two configurations that differ by a single spin 



flip, odd order terms do not contribute in Eq. (2-3), as one requires an even number 



of flips to come back to the initial configuration in the sums. If the starting energy 
Ei is close to the ground state, it is negative and of order N. On the other hand, 
the vast majority of levels have energies Ek ~ 0(y/N) . Hence, all terms of the form 
(Ek — Ei) ~ O(N): the spin flips from the lowest levels induced by the a x operators 
do not connect the lowest states amongst themselves. One obtains, starting from an 
low eigenvalue [—Ei = O(N)], that 



k^i 



Ei — Ek Ei 



1 N 



k=l 



N 
Ei 



+ o 



where we have used that the Ek are random and typically of order v N. Higher rath 
orders are computed in the same spirit and are found to be 0(N n ^ 2 ~ 1 ). Therefore, 
to all (finite) orders, we have for the energy density 



N ■ 



ei(r) = ei + 



11 

Ne,, 



+ ... = €i + 



(2-4) 



This analytic result compares well with a numerical evaluation of the eigenvalues (left 
panel of Fig. [2]). Note that the energy density of all extensive levels is independent 
of r to leading order in N, as are hence s(e) and f(T). 

A similar expansion can also be performed around the extreme quantum limit, 
using TV as a starting point and TIq as a perturbation. Consider the ground state 
with eigenvalue Eo(r) and the unperturbed ground state having all spins aligned 
along the x-direction, with Eq(T) = —TN. In the base corresponding to the eigen- 
values of rV, we find 



E (r) = <(r) + (o | Ho | o) + 



\(k\Ho\0)\< 



o "0 ( r ) 



E> 



EY 



+ 



The first-order term gives Yla=i E, 



REM I 



Since the energies of the REM are 



random and uncorrelated with v a this sums to 0(y/N2 N / 2 ). For the second-order 
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term, one finds 



E 



\(k | Ho 



EX(D 1 



Kin 



(0 I Hi I 0) 



2V 



|(fc|^o|0)| 2 

-EX(r)/E%(r) 



2EX(r) 



+ o(l). 



(2-5) 



Subsequent terms are treated similarly and give vanishing corrections so that eo(-0 

/ — 2^fp + O(j^z). Again this derivation holds for other states with extensive 
energies —Ef(r) = O(N), the only tricky point being the degeneracy of the eigen- 
values, 21 ) and for these excited eigenstates, the perturbation starting from the large 
r phase yields ei(r) = ef(r) — + 0(^). Just as in the opposite classical limit, 
to leading order in N, energy, entropy and free-energy densities are not modified by 
the perturbation. 

2.3. Phase diagram and the closure of the gap 

All that we have been saying up 

to now implies that, to leading order, , , , 

the partition function can be written 14 

as: 12 - 



Z = Tre _/3(Hrem " rJ:r) (2-6) 
ps min ( Tre~ N/3fREM ,Tre~ mfpara 



REM 'unfrozen' 
f=-Tln(2)-1/4T 



I Quantum Paramagnet 



f=-T ln(2) 
-T In cosh(m) 



REM 'frozen' 
f=-(ln2) 1 ' 2 



so that the equilibrium free energy 
is simply the minimal between the 
REM and the paramagnetic one, and 
a first order transition appears be- 
tween the two. This allows us to im- 
mediately deduce the thermodynamic 
of the problem, shown in FIG{T] The 
first order transition between the two 
phases amounts to a sudden localiza- 
tion of the wave function into a sub- 
exponential fraction of classical states 
at low r. 

At the phase transition the two 
lowest levels have an avoided crossing. 

Our task is to find how close in energy they get. To calculate the gap, we proceed 
as follows: Suppose that we have a value of r such that for that sample the ground 
state E of H rem and —TN of —TJ X are degenerate. The corresponding eigenstates 
we denote \SG) and \QP) (spin- glass and quantum paramagnet, respectively). To 
lift the degeneracy, we diagonalize the total Hamiltonian in the corresponding two- 
dimensional space and obtain 



Fig. 1. Phase diagram of the QREM in tempera- 
ture T and transverse quantum field r. There 
are three phases: the classical unfrozen and 
frozen ones and the quantum one. The clas- 
sical region is separated from the quantum 
one by a first order transition (thick line). 
At T = the quantum first order transition 
arises at r c = %/hi 2 while the classical glass 
transition for F = is at T c = 1/ \An 2. 



H\ 



E \SG)(SG\ - rN\QP)(QP\ ]|0) = A|0> 



(2-7) 
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Multiplying this equation by (SG\ and {QP\, respectively: 

- \(SG\4>) = E (SG\SG)(SG\4>) - r{SG\X){SG\<(>) 

-\(QP\<P) = E o (QP\SG)(SG\0) - r{QP\QP){QP\<t)) (2-8) 

In order for A to be an eigenvalue, the determinant of this system must vanish 

-(E o -X)(r + X) + E o r{SG\QP) 2 = (2-9) 

where we have used that the states are normalized. The gap is the difference of the 
two solutions and reads 

gap(N, rf = (r- E f - 4 \-E T + E o r{SG\QP) 2 ] (2-10) 

and at its minimum with respect to r, we thus get 

gap min (N) = 2\E \2~ N ' 2 (2-11) 




0.6 

r 



16 
N 



Fig. 2. Left: Evolution of lowest energy levels for a single realization of the QREM with N = 20 
spins (dots) compared with analytical predictions (lines). The 40 lower eigenvalues are evaluated 
via Lanczos iteration. Right: Evolution of the ensemble averaged minimal Gap at the transition, 
together with the asymptotic analytical prediction. 



§3. Numerical simulations 

The matrix elements of Ti.^ = E a and TIq^ 13 = 0, while V a B = 1 if a and j3 are 
two configurations that differ by a single spin flip and zero otherwise. Ti is sparse 
and can be studied numerically rather efficiently even for large system sizes using 
Arnoldi and Ritz methods. 22 ) We thus have performed a set of numerical studies on 
these matrices, until N = 24. We shows our results in FIGj2]and FIGj3} 

The prediction for the closure of the gap as A m i n (N) = 2\E \2~ N ^ 2 compares 
very well with numerical simulation, even for small numbers of spins (see FIGJ2]). 
Notice, however, that there are strong fluctuations from sample to sample (see 
FIG§). 
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Fig. 3. Energy gaps between the ground state and the first excited state in the QREM for 10 
realizations for TV = 12 (left) and N = 18 (right). Notice the strong fluctuations between 
samples. As N grows, the region where the gap closes shrinks and the slope around the critical 
point is growing dramatically. This shows that one has to be extremely cautious when performing 
simulation in this region. 



§4. Computing the gap in the generic case within the replica method 

The usual way of computing the free energy of a quantum spin system is to start 
with the trace Tr[e~@ H ]. One works in imaginary time and uses a a Suzuki- Trotter 
decomposition. 18 )' 25 )~ 27 ) In this way one obtains an ansatz for the spin-glass phase, 
and a different one for the quantum paramagnetic phase, yielding free energies F$g 
and Fqp, respectively through —(3Fsg ~ lnTr[e~^ H ] or — /3-Fqp ~ In Tr[e~@ H ], 
depending on the phase. 

Consider now the situation with the system near the phase transition, having 
two almost degenerate ground states \SG) and \QP), H$g = (SG\H\SG) ~ Hqp = 
(QP\H\QP) and a small interaction matrix element Hj = (QP\H\SG) . To obtain 
the gap between levels, we have already diagonalized this 2x2 matrix exactly in the 
previous section. Alternatively, we can use the classical expansion: 

Tr[e-P H ] =J2l f dt 1 ...dt r e-l t ™ H sG+t?£H Q p] {Hi y (4 . 1} 

r ' 

where the system jumps at times ti,...,t r between the states \SG) and \QP), t 
and tf Q f = (3 — tf^ denote the total time spent in each state. 



tat 



What equation (4-1) tells us is that if we find a solution in imaginary time 
that interpolates between the quantum paramagnet and the spin-glass solutions by 
jumping r times, t\, ...,t r , and we find that the free energy has a value: 

PF {r jumps} ~ t^F SG + t^F QP - rG(interface) (4-2) 

then by simple comparison InHj ~ G(interface) leading to gap ~ e G . An extensive 
value of G for the interface implies an exponentially small matrix element, and 
hence an exponentially small gap. We shall now show that this is the situation for 
all models of the 'Random First Order' kind. Indeed, this is just the usual instanton 
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construction, the difference here will be that they take a rather unusual two-time 
form in problems with disorder. 

Let us look for solutions interpolating between vacua. We consider the p-spin 
model in transverse field and shall follow the presentation and notation^ of Obuchi, 
Nishimori and Sherrington. 23 ) The Hamiltonian is: 

« = - E J m h< ■ ■ ■ < - r E °i { h:Vl 

ii,...,i p i 

with ^,..,0 = (-^-J e-— ^ (4-4) 

In order to solve the system, we first apply the Trotter decomposition in order 
to reduce the problem to a classical one with an additional "time" dimension: 

Z= lim Tr ( e -PT/M e -pv/M\ M = nm Z (4 . 5) 



where 

M M 

M 



Z M = C MN Ti exp I T7 E E J h-ip a h,t ■ ■ ■ a i P ,t + 5 E E "M^M-i 



t=l ii<...<i p t=l i 

' (4-6) 
i 

and we have introduced the constants B = ^ In coth ^ and C = f | sinh ^jp^j 2 ■ 
Replicating n times, and carrying over the averages over the interactions, we 

get: 



E f^E<<<.T + B EEE 



4M 2 ^ ^ \ JV 

t,t'=l fi,v=\ \ i / t=l fi.=l i 



where the replica indices are denoted by fi and za 

In order to solve problem, it is then necessary to introduce a time-dependent 
order parameter and its conjugate Lagrange multiplier q 1 ^ for the constraint 
Itt' = *£2i a it a it'/N- With these notations, the replicated trace reads: 

[z n M \ = e- N " F = [ n n n n 

^ M<v t,t' ^ t^t' 

32 T 2 



xexpiV EE(f^(^T-]^W) 

+EE(jSw")'-i ? «') + lF °) 

t,t' A* J 



(4-7) 



*' With the only exception of our qf t , and qf t ,, which correspond to their R tt i and R t] 
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where W a = log Tr exp (— H e g), and: 

#cff = -b Yl a t a t+i -thY^YI <%t>°t<> 



H<v t,t' 



M 2 



(4-8) 



We calculate the free energy of the replicated system in the thermodynamic limit by 
the saddle-point method: 



(4-9) 



The brackets (• • • ) denote the average with the weight exp(— H c g). 

We now make the one-step replica symmetry broken ansatz: for every (t, t') the 
parameter q^, is as in Fig |4j Within the 1RSB ansatz, the replicated free energy 




Fig. 4. The one-step replica symmetry breaking ansatz. The two-time two-replica overlap q 1 ?", has 
the following structure. We divide replica in m groups and the overlap between replica in 
different group is zero while the overlap between replicas of the same group is q t t' if the replica 
are different (/mu ^ v), are qf t , is the replica are the same (fi — v on the diagonal). 



reads: 



Pf 



dt dt' 
1 



P 2 J 2 



-(l-m)g&, 



Wo[qf H ,,qw] (4-10) 



Up to here we have followed the standard steps 18 )' 23 )> 25 )~ 27 ) Solutions within 
this ansatz corresponding to the spin glass and the quantum paramagnet have been 
studied by several authors. 18 **' 23 * ),25 )~ 27 * ) It turns out that the phenomenology for 
finite the p is very close to that of the QREM. 
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We now part company with the previous literature, and consider a solution 
corresponding to the high-i -1 phase in the interval (0, t±), (t2,ts),..., that jumps to the 
low-.T phase where it stays in the intervals (ti, ^2)3 (^^s))--- The time-dependence 
of qt y t< and qf t , are is as in Fig. (pL 





(1,2) 


(1,1) 


(1,2) 


(2,1) 


11 


(2,1) 




(1,1) 


(1,2) 


\ 

\ 

\ 

\ 


(1,2) 


(2,1) 






(2,1) 





2 



2 



12 1 2 \ 



Fig. 5. A multi-instanton configuration for qf f/ , q t ,t' , Qtt' an< i <?t,t'- Three different shadings cor- 
respond situations in which the system is in the glass phase at both times, the paramagnetic 
phase at both times and in a different phase at each time. In general, the functions q t ,t' , Qt,t' 
are approximately constant well within each region, with smooth, finite width interfaces. The 
diagonal elements qf t , and qf t , have an additional crest along the diagonal t = t'. In the large 
p limit, we may neglect this crest, in the so-called 'static approximation'. In addition qf t , and 
q t ,t' become either infinity or zero, with sharp interfaces: this allows for a complete solution at 
large p. 



4.1. Recovering the REM result 

Let us now specialize to the large-p situation, and we shall later indicate how 
to proceed in general. Following Obuchi et ai, we note the saddle point equations 
imply that for large p either (q tt > , qf t , , q t f , qf t ,) = (1,1, 00, 00) or {q tt > , qf t , , q tv ,qf t ,) = 
(< 1,< 1,0,0)). This implies that the form of the instanton configuration of qf t , 
and qu' is the same as the one of (qtt', Qtt' w ith the values jumping from zero to 
infinity. If in addition we make the 'Static approximation' that as applied to this 
case consists of assuming that inside each block the order parameters q d and q d are 
constant, we conclude that for all times we can write the 'tilde' variables as: 

- Qt't' = rfrf, ; q n , = r t r t > (4-11) 

where rt and rf are large in the time intervals when the system is in the glass state, 
and drop to zero when it is not. (The solutions in the literature correspond to time- 
independent r, taking a value corresponding to either the glass or the paramagnetic 
phase) 
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Because qf, t ,, q t >t' are either zero or one, we can write: 

1 2 



dt dt' qtt'qtt' 



dt r(t) 



dt dt 1 q w q% = dt dt' [r d (t)r d (t') + r{t)r{t')] 



I 2 , + I 2 



(4-12) 



with the definitions I = f dt r(t) and Id = f dt r d (t). 

We further decouple the replicas in the single-spin term in the usual way: 

W = log Tr exp {-H eS ) = -— log 



in 



Dz 2 



Dz 3 



(4-13) 



We can go back to the quantum representation, to write the trace in (4-13) as a 
single quantum-spin in a time- dependent field: 

Tr ^T e Sdt'{A{t'W+pra^ 

where T denotes time-order (a necessity here because of the time-dependence in the 
exponent) , and A(t) = (z^rf + Z2Tt). In the periods where A is non zero, it has a 
large real part and the spins are polarized along the z direction. During the periods 
when rt = rf = A = only the transverse term proportional to r plays a role. This 
corresponds to the switching between spin-glass and quantum paramagnetic phases, 
respectively. The trace can be computed easily by changing bases accordingly. At 
low temperatures, the 'field' in the x direction (3T is strong, while the field in the 
z direction |^4.(£)| is either zero or >> (3T (for large p, cf. Eq. ( |4-9| )). We 

conclude then that only one polarization of the spin contributes in each time interval. 
Denoting 

(4-15) 



Tr ^ e Jdt>(A(t')*z+pr**y 
{x\^-^ ra "\x) (x\z 2 ) ... {z n \e^ dt ' A{tl)uZ \z n ) 



Where we have defined \x) the lowest eigenvalue of a x , and the \zi) are either the 
lowest or the highest eigenvalue of a z , depending on the sign of A(t) (which in turn 
depends on Z2,zz) during that interval. Because, as mentioned above, at each time 
only one field dominates, and the way we chose the \zi), we have: 



(z i \eS%<# A W°'\zi)~e&'*\ A W\ 



and 



(x\e 



(4-16) 



(4-17) 



Hence, if we denote t 



SG 



OP the total time in which n, r d are not zero, and 



Qt = Qt 



1, and t® p = (1 — 0)f3 the rest, the action becomes: 



(3f = 2 



— (l-m) + — 



m 



+ (1 — Q)j3r + (numb, of jumps) x In 



(4-18) 
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where 



W z 



log { / Dz 2 



m 



log<^ / Dz 2 

m 



DZ3 e I dt \ z 2n+z 3 rf\ 
Dz 3 e I^W d | 



This can be evaluated by saddle point, 18 )' 23 ) putting Z3 = I^yz and z 2 = 
recognizing that I, Id are large. There are two saddle points: (2/2 = 1,2/3 = 
(2/2 = —1,2/3 = —1) with the same contribution. A short calculation yields: 



W z 



1 9 m 9 , . . 

2^ 2 + y' 2 + M2) 



Iy 2 and 
= 1) and 



(4-19) 



Equation (4-18) becomes 



-pf = m 



ln(2) 



m 



+ (1 - G)/3F + (numb, of jumps) xln|(a?|z)| (4-20) 



Taking saddle point with respect to m gives m 



(3f = 0y/]n(2)^- + (1 - Q)pr + (numb, of jumps) X In \{x\z)\ (4-21) 



2^ 

0/3 J • 



We finally obtain 



This formula is of the form (4-2 ). It gives the contribution to Tr[e~@ H ] of the process 
with a number of jumps spending a fraction in the glass state and (1 — 0) in the 
paramagnetic state. We have hence showed that the logarithm of matrix element is 
indeed the single-spin element ~ iVln|(x|2:)| = — iVln(2) from which we recover the 
gap ~ 2~ N obtained previously. 

4.2. The general case 

In the general case, we need to determine the functions qf t , and qw for the 
interval < t, t 1 < (3. It suffices to compute a single jump solution, and to calculate 
the free energy cost of the "wall" in the two times. This may be done numerically, 
discretizing the times (i.e. working in a two-time grid) and minimizing with respect 
to qu> while maximizing with respect to the diagonal replica parameters qf t ,, as is 
usual in the replica trick. 

The solution must be such that the order parameters qf t , and qu> are for small 
t, t' close to those computed for the quantum paramagnet, for t,t' near (3 close to 
the solution for the glass phase, and for mixed times (one large and one small) a 
constant corresponding to the phase-space overlap between both phases — typically 
zero. 

At precisely the values of parameters such that the free energies of both pure 
solutions coincide, we have an extra free energy density cost is due exclusively the 
(smooth) walls separating the four quadrants in the two-time plane. Their precise 
form, and their free energy cost, has to be determined numerically. If their cost in 
free energy density is larger than zero, this is the value of the exponential dependence 
in the gap. 
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An interesting situation arises in models where the one-step replica symmetry 
breaking ansatz for the pure quantum phases is not exact, such as the quantum 
Sherrington-Kirkpatrick model. In that case, we should generalize the ansatz to 
allow a full replica symmetry breaking. This will not be the end of the story in such 
models, as the cost of the wall in the two-time plane may vanish to leading order in 
N, reflecting the fact that barriers are subextensive in height and equilibrium states 
are at all possible distances. In such cases, one should compute the free energy 
of an instanton solution scaling slower than the system size, i.e. the subextensive 
corrections. This is beyond our present technical capabilities. 



§5. Discussion 



We have described an analytic technique to compute the minimal gap between 
the two lower quantum levels of a class of mean- field glass problems. The nature of 
the solution suggests that all models having the "Random First Order" phenomenol- 
ogy will have an exponentially small gap, implying that quantum annealing cannot 
find the ground state in subexponential time. The same two-time instanton tech- 
nique may be generalized to "dilute" systems, where the connectivity is finite but 
locally tree-like and it would thus be interesting to adapt it to the cavity setting 
developed in. 28 ) The reader interested in seeing how the computation works in a 
simpler setting, in absence of disorder, is referred to. 29 ) 

Notice also that over the last few months, the first order transition scenario has 
been confirmed by numerical simulations in 30 ) as well as with analytical results in 
diluted systems. 31 ) 
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